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ABSTRACT 


The  problem  of  designing  an  observer  which  is 
both  minimum-cost  and  minimum-time  is  considered  in 
this  thesis.  By  cost  is  meant  a  quadratic  functional 
of  the  estimation  error. 

For  minimum-time  observers  the  procedure  involves 
a  selection  of  a  minimal  nilpotent  matrix  by  using  a 
suitable  canonical  representation  for  the  plant,  so 
that  the  estimation  errors  vanish  in  a  minimum  number 
of  steps.  For  minimum-cost  observers,  the  procedure 
is  based  on  a  minimization  of  the  cost  due  to  the  esti¬ 
mation  error.  The  dependence  of  the  performance 
measure  on  the  initial  conditions  of  the  unmeasurable 
state  variables  is  eliminated  by  averaging  the  per¬ 
formance  index. 

The  choice  of  a  particular  canonical  representa¬ 
tion  for  the  system  leads  to  a  simple  procedure  for 
observers  which  simultaneously  minimize  the  performance 
measure  on  the  average  cost  and  the  time  required  to 
yield  errorless  state  variables.  Computer  simulation 
results  showing  the  performance  of  the  various  observers 
are  presented. 
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CHAPTER  1 


INTRODUCTION 

1.1  General  Introduction 

Systems  are  designed  and  built  so  as  to  perform 
certain  defined  functions  such  as,  for  example,  pole- 
assignment  or  regulation.  In  order  for  the  systems  to 
carry  out  these  functions,  we  adopt,  in  general,  the 
feedback  technique  in  which  knowledge  of  the  entire 
state  of  a  system  is  required.  However,  there  are,  in 
practice,  many  situations  in  which  some  of  the  state 
variables  are  not  available  for  direct  measurement.  In 
these  situations,  the  control  law  requiring  all  the 
state  variables  cannot  be  implemented  without  additional 
hardware . 

Either  an  approach  in  which  the  control  variables 

are  generated  directly  from  the  available  outputs  of 

* 

the  system  must  be  used  [1]  or  estimates  of  the  un¬ 
measurable  state  variables  must  be  made  which  can  be 
substituted  into  the  control  law.  In  general,  it  has 
been  found  that  the  latter  approach  is  vastly  simpler 
than  a  direct  method  mentioned  earlier  [2]. 

Two  dynamic  systems  have  been  developed  for  esti¬ 
mating  the  state  variables  of  a  system:  Kalman  filter 
for  a  stochastic  system  and  Luenberger  observer  for 

Numbers  in  [  ]  denote  references  listed  at  the  end  of 
this  thesis. 
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a  deterministic  system.  A  Kalman  filter  estimates  the 
entire  state  vector  such  that  the  variance  of  the  esti¬ 
mation  error  is  minimized  in  a  noisy  environment.  The 
parameters  of  a  Kalman  filter  are  thus  directly  deter¬ 
mined  by  the  knowledge  of  the  statistical  characteris¬ 
tics  of  the  environmental  noise.  On  the  other  hand,  the 
designer  has  some  freedom  in  determining  the  dynamics 
of  a  Luenberger  observer  which  estimates  a  linear  trans¬ 
formation  of  the  unmeasurable  states  of  the  given  system. 
This  freedom,  in  turn,  poses  another  attractive  problem 
in  observer  design  procedure,  and  as  a  consequence  it 
has  received  much  attention  in  recent  years. 

In  this  thesis,  we  discuss  several  useful  design 
methods  that  have  been  developed  by  others  and  present 
a  new  method  of  observer  design.  The  resulting  observer 
possesses  attractive  characteristics.  We  shall  restrict 
the  discussion  to  linear  time  invariant  discrete  systems. 

1.2  Theory  of  Observation 
i)  Basic  Theory 

Consider  the  completely  observable  linear  time- 
invariant  discrete  system  governed  by: 


x (k+1)  =  Ax (k)  +  Bu (k) ; 


y (k)  =  Cx (k) 


(1-1) 


■ 

' 

■ 
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where 


x  is  an  nxl  state  vector, 
u  is  a  pxl  control  vector, 
y  is  an  mxl  output  vector, 

A  is  an  nxn  plant  matrix, 

B  is  an  nxp  distribution  matrix, 

C  is  an  mxn  output  matrix 

and  without  loss  of  generality,  C  is  assumed  to  be  of 
full  rank,  and  the  "observer"  governed  by: 


z(k+l)  =  Fz(k)  +  Gy(k)  +  Hu(k) 


(1-2) 


which  is  driven  by  the  inputs  and  outputs  of  the  system 
(1-1)  where  the  observer  matrix  F  is  a  stable  matrix 
(i.e.  the  eigenvalues  are  within  the  unit  circle).  Then 
we  can  write: 


z(k+l)  -  Tx(k+1)  =  F[z(k)  -  Tx(k)]  +  [GC 


TA  +  FT] x (k)  +  [H-TB ] u (k) 


(1-3) 


and  z (k+1)  -  Tx(k+1)  =  F[z(k)  -  Tx(k)] 


(1-4) 


if  T  is  chosen  such  that: 


TA  -  FT  =  GC 


(l-5a) 


H  =  TB 


( l-5b) 


■ 


. 


. 


Since  F  is  a  stable  matrix  the  solution  to  the 


homogeneous  eqn.  (1-4)  is: 

z(k)  -  Tx (k)  =  Fk[z(0)  -  Tx ( 0) ]  (1-6) 

implying  that  z(k)  ■+  Tx(k)  as  k  -*  » 

Thus  the  system  (1-2)  asymptotically  estimates  the  linear 
transformation  of  the  state  vector  of  the  system  (1-1). 

Furthermore,  if  z (0)  =  Tx(0)  then  the  observer 
[system  (1-2)]  yields  an  exact  linear  transformation  of 
the  state  vector  x  at  every  step. 

The  condition  for  existence  of  the  unique  solution 
for  T  to  eqn.  (1-5)  is  that  the  matrices  A  and  F  do  not 
have  any  eigenvalues  in  common  [2] ,  [3] .  Thus  all  the 
eigenvalues  of  the  matrix  F  must  be  chosen  to  be  dis¬ 
tinct  from  those  of  the  matrix  A.  It  should  be  noted 
that  since  the  observer  estimates  a  linear  transforma¬ 
tion  of  the  state  vector,  the  matrix  T  must  have  a  rank 
large  enough  to  enable  the  observer  to  recover  all  the 
unmeasurable  state  variables. 

ii)  Identity  Observer 

It  would  be  obviously  convenient  to  choose  the 
transformation  T  relating  the  state  z(k)  to  the  state 
x(k)  as  the  identity  transformation  I  .  Then  eqn.  (1-5) 


, 


■ 

' 


, 


becomes : 


F  =  A  -  GC 


(l-7a) 


H  =  B 


(l-7b) 


Hence : 


z(k+l)  =  (A  -  GC)z(k)  +  Gy (k)  +  Bu(k) 


(1-8) 


is  an  identity  observer  which  is  of  the  same  order  as  the 
observed  system  (i.e.  n) . 

While  any  nxm  matrix  G  leads  to  an  identity  observer 
the  dynamic  response  of  the  observing  process  is  com¬ 
pletely  determined  by  the  eigenvalues  of  the  matrix 
A  -  GC.  Since  the  eigenvalues  of  the  matrix  A  -  GC  can 
be  arbitrarily  placed  by  a  suitable  choice  of  G  if  and 
only  if  the  pair  (A,  C)  is  completely  observable,  we 
have  the  following  result: 

An  identity  observer  having  arbitrary  dynamics  can 
be  constructed  for  a  linear  system  if  and  only  if  the 
system  is  completely  observable  [2] . 

In  practice,  the  eigenvalues  of  the  observer  are 
chosen  to  be  closer  to  the  origin  than  those  of  the 
observed  system  so  that  convergence  is  faster  than  other 
system  effects.  Notice  that  if  the  matrix  G  is  chosen 
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such  that  the  eigenvalues  are  all  zero  then  the  observer 
produces  the  exact  state  x  in  at  most  n  steps. 
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iii)  Reduced  Order  Observer 


The  identity  observer  though  possessing  an 


ample  measure  of  simplicity  also  possesses  a  certain 
degree  of  redundancy.  This  comes  from  the  fact  that 
while  the  identity  observer  constructs  an  estimate  of 
the  entire  state  vector,  part  of  the  state  vector  as 
provided  by  the  system  outputs  are  available  by  direct 
measurement.  This  redundancy  can  be  eliminated  and  an 
observer  of  lower  order  but  still  having  arbitrary 
dynamics  can  be  designed. 

Since  the  output  matrix  C  is  of  full  rank  m,  the 
output  vector  y(k)  itself  provides  m  state  variables 
through  measurement.  In  order  to  estimate  the  remaining 
n-m  state  variables  an  observer  of  order  n-m  is  con¬ 
structed  with  the  state  z(k)  which  approximates  Tx(k) 
for  a  suitable  (n-m)xn  matrix  T.  Then  if  the  partitioned 
nxn  matrix: 


C 


(1-9) 


M 


T 


is  nonsingular  (i.e.  invertible)  an  estimate  x(k)  of  the 
entire  state  vector  x(k)  is  determined  by: 


x(k) 


(1-10) 


jz  (k)_ 


' 

' 


CONTROLLER 
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Thus  the  matrix  associated  with  the  observer  must 
have  n-m  independent  rows  which  are  also  linearly 
independent  of  the  rows  of  C. 

The  matrices  F  and  G  can  be  expressed  in  terms  of 
the  matrices  T,  D  and  E. 


F  =  TAE 


( 1-lla) 


G  =  TAD 


(1-llb) 


where 


n  n-m 


(1-12) 


The  reduced  order  observer  can  be  incorporated  into 
the  flow  diagram  as  shown  in  Fig.  1. 


1.3  Gopinath's  Method  [4] 

It  is  shown  in  the  following  section  that  although 
any  matrix  T  satisfying  eqns.  (1-5)  and  (1-9)  leads  to  a 
reduced  order  observer,  a  particular  choice  of  T  leads 
to  a  simple  and  elegant  design  procedure. 

Again  the  system  under  consideration  is  described  by: 


x(k+l)  =  Ax (k)  +  Bu (k) ; 


y (k)  =  Cx(k) 


(1-13) 


. 


» 


' 


With  no  loss  in  generality,  C  can  be  assumed  to  be  of 
the  form: 


C 


1  0  ] 
i 


(1-14) 


by  introducing  a  change  of  coordinates.  It  is  convenient 
to  partition  the  state  vector  x  as: 


w 


where  w  is  the  unmeasurable  part  of  the  state  vector  x 
and  the  matrices  A  and  B  as: 


A 


A 


A 


11 

21 


A 


A 


12 


22 


! 

) 


m 

n-m 


m  n-m 


Then  system  is: 


(1-16) 


y(k+l)  =  A^y(k)  +  A-^2w(k)  +  B-^u(k)  (l-17a) 

w(k+l)  =  A22w(k)  +  A21y(k)  +  B2u(k)  (l-17b) 

Since  the  system  (l-17a)  provides  the  measurement 
A12w(k)  for  the  system  (l-17b),  which  has  w(k)  as  its  n-m 
state  vector  and  A21y(k)  +  B2u(k)  as  its  input,  an 


- 


' 


identity  observer  of  order  n-m  is  constructed  for  the 
system  (l-17b)  using  this  measurement.  The  theorem 


10 


[see  Appendix  A]  which  says  that  if  the  pair  (A, 
completely  observable,  so  is  the  pair  (A22,  A12^ 
the  reconstruction  of  an  estimate  w(k)  of  w(k) . 

An  identity  observer  for  the  system  (l-17b) 
the  measurement: 


C)  is 
justifies 

with 


A12w(k)  =  y (k+l)  -  AllY(k)  -  BlU(k)  (1-18) 

is  given  by: 

w(k+l)  =  [A22  +  LA^2  ]  w  (k)  -  L[y(k+1) 

-  Alxy (k)  -  B^u (k) ]  +  A21y(k)  +  B2u(k)  (1-19) 


where  the  elements  of  the  (n-m)xm  matrix  L  are  the 
free  design  parameters  which  should  be  suitably  chosen 
subject  to  the  restriction  that  the  matrix  A22  +  LA-^2 
is  stable. 

If  z (k)  is  defined  as  w(k)  +  Ly(k),  the  requirement 
for  measuring  the  delayed  y(k)  (i.e.  y(k+l))  can  be 
avoided: 


z (k+l )  =  (A22  +  LA12)z(k)  -  (A22  +  LA12)Ly(k) 

+  (a21  +  LA11)y(k)  +  (B2  +  LB1)u(k) 

=  Fz(k)  +  Gy(k)  +  Hu(k) 


(1-20) 


1  'I 
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Eqn.  (1-20)  exclusively  defines  the  matrices: 


F  A22  +  LAi2 


( l-21a) 


G  =  -FL  +  A21  +  LAn 


( l-21b) 


H  =  B2  +  LB1 


( l-21c ) 


The  observer  state  z(k)  asymptotically  estimates 

Tx(k),  a  linear  transformation  of  the  observed  system 

vector,  where  T  =  [  L  '  I  ] ,  that  is 

1  n-m 


z(k)  =  Tx(k)  =  Ly(k)  +  w(k)  ->  Tx(k)  as  k  ->  °° 


The  estimate  w(k)  of  w(k)  is  given  by 


w(k)  =  z(k)  -  Ly(k) 


(1-22) 


and  the  error  in  an  estimate 


e  (k)  =  w  (k)  -  w  (k) 


(1-23) 


satisfies  the  homogeneous  equation: 


e (k+1)  =  Fe (k) 


(1-24) 


' 


1.4  Criteria  used  in  Observer  Design 


The  matrix  T  in  the  observer  design  is  chosen  to 
satisfy  some  design  criterion.  While  the  usual  procedure 
is  to  assign  a  predetermined  set  of  eigenvalues  to  the 
matrix  F,  we  shall  in  this  thesis  examine  the  choice  of 
L  to  meet  the  following  two  criteria: 

i)  Minimum  cost,  and 
ii)  Minimum  time. 

The  first  criterion  refers  to  the  minimization  of 
a  quadratic  function  of  the  state  estimation  error  e(k) 
of  the  following  form: 

00 

J=  l  e ' (k) Qe (k) ,  Q=Q'>0  (1-25) 

k=0 

The  quadratic  nature  of  this  cost  functional  penalizes 
large  errors  more  heavily  than  small  ones  and  thereby 
helps  to  reduce  any  large  overshoots  in  the  estimation 
errors . 

The  second  criterion  concerns  the  observer  which  is 
able  to  yield  the  exact  state  vector  of  the  observed 
system  in  the  minimum  number  of  steps.  This  criterion, 
in  general,  unique  only  to  the  discrete  system  would 
be  extremely  useful  when  designing  a  dead-beat  controller 
for  the  system  with  some  inaccessible  state  variables. 


•- 

. 
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1 . 5  Scope  of  This  Thesis 


The  work  reported  in  the  following  chapters  will 
mainly  focus  on  the  optimal  observers  in  the  sense  of 
the  minimum  time  and  the  minimum  cost  for  the  finite 
dimensional  linear  time-invariant  discrete  system. 

In  chapter  two,  the  design  methods  developed  by 
Nagata  [  8  ]  and  Porter  [10]  for  the  minimum-time  observer 
are  reviewed  and  the  similarity  between  the  two  methods 
is  discussed. 

Chapter  three  deals  with  the  design  method  for  a 
minimum-cost  observer  developed  by  Gourishankar  and 
Kudva  [14  ]  . 

In  chapter  four,  a  simple  procedure  for  designing 
a  minimum-cost,  minimum-time  observer  for  the  linear 
discrete  system  is  presented.  To  the  best  knowledge 
of  the  author  this  is  a  new  procedure. 

In  chapter  five,  the  results  of  simulating  both  the 
minimum-cost  and  the  minimum-time  observers  on  a  digital 
computer  are  discussed. 

Chapter  six  summarizes  the  results  studied  in  this 
thesis  and  states  conclusions.  A  few  suggestions  for 


further  research  are  also  made. 
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CHAPTER  2 


MIN I MUM- TIME  OBSERVER 

2.1  Introduction 

In  some  applications,  we  need  an  observer  which  is 
able  to  reconstruct  an  errorless  estimate  of  the  plant 
as  fast  as  possible.  This  is  the  situation,  for  example, 
in  the  design  of  the  dead-beat  controllers  with  some 
unknown  state  variables. 

The  minimum-time  observation  problem  is  similar  in 
concept  to  the  minimum-time  control  problem,  which 
Kalman  et  al  [5]  first  considered  for  the  single-input 
system.  The  analogous  method  for  the  observer  was  dis¬ 
cussed  by  Ichikawa  [6]  for  a  particular  multi-output 
system.  Nagata  et  al  [7] , [8]  generalized  this  method 
further  and  introduced  the  reduced  order  observer  for 
the  multi-input,  multi-output  system.  A  more  simplified 
method  using  the  Luenberger  canonical  form  has  been  pro¬ 
posed  by  Porter  and  Bradshaw  [10] . 

The  homogeneous  error  equation  (1-24)  for  the 
observer  is  totally  determined  by  the  observer  matrix 
of  which  eigenvalues  can  be  placed  arbitrarily,  as  long 
as  the  observed  system  is  completely  observable.  If 
the  observer  matrix,  in  particular,  has  all  zero 
eigenvalues  (i.e.  nilpotent  matrix.  Nilpotency  is  defined 
in  the  next  section.)  the  error  vanishes  in  at  most 
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y  steps  where  y  is  the  nilpotency  index  of  the 
observer  matrix.  This  implies  that  the  finite-time 
observer  yields  an  exact  estimate  of  the  plant  in  at 
most  y  steps.  Furthermore,  if  the  nilpotency  index  Y  has 
the  minimum  value,  the  corresponding  observer  can  re¬ 
construct  the  errorless  estimate  in  minimum  time. 

2.2  Nilpotent  Matrix 

Nilpotent  matrices  play  an  important  role  in  the 
minimum-time  observer  design  for  the  discrete  system. 

In  this  section,  we  shall  consider  the  basic  concepts 
relating  to  and  properties  of  nilpotent  matrices.  A 
more  complete  treatment  of  this  topic  can  be  found  else¬ 
where  [11] ,  [12]  . 

Definition:  An  nxn  matrix  N  is  said  to  be  a  nilpotent 

matrix  with  the  index  y  if 


and  ^  7^  0 


(2-1) 


Theorem  1 


If  there  exists  an  nxl  vector  u  such  that 


1  u  ^  0 


(2-2) 


then  the  vectors  u,Nu,N  u 
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Proof : 


Assume  that 


2  v— 1 

o^u  +  a2Nu  +  a3N  u  +  ...  +  a^Ny  u  =  0 


(2-3) 


The  successive  multiplication  by  N  thus  gives: 


2  3  _  -| 

ot-^Nu  +  a2N  u  +  a3N  u  +  ...  +  a  u 


=  0 


a,N  u  +  a0N  u  +....+  a  ~N 
12  y-2 


y-1 
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(2-4) 


Y— 1 

axN y  u 


=  0 


y—  1 

N  ^  0  implies  that 


al  a2 


=  a  =0 
Y 


(2-5) 


so  that  the  vectors  are  linearly  independent  and  since 
more  than  n  vectors  in  the  n-dimensional  Euclidian  space 
are  always  linearly  dependent,  y  must  be  equal  to  or 
less  than  n. 


Theorem  2 

The  Jordan  canonical  form  for  a  nilpotent  matrix 
obtained  by  a  similarity  transformation  is  of  the  form: 


NT  =  diag  (N^/N 
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(2-6) 
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where  the  ixi  matrices  (1=1, 2 , ...s)  have  the  form: 


0  1 


x 

N  \ 

0  '  /I 
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s 

Max  i  =  y;  J  i  =  n 
i=l 


(2-7) 


(2-8) 


and  T  is  the  matrix  of  the  transformation.  y  is  the 
nilpotency  index  of  N. 

P r oo f :  See  Appendix  B . 

It  is  clear  that  a  nonzero  nilpotent  matrix  must 
be  singular  and  the  dimension  of  the  largest  Jordan 
block  is  equal  to  the  nilpotency  index. 

In  the  following  sections,  we  shall  consider  two 
procedures  [8], [10]  which  make  use  of  the  properties 
of  the  nilpotent  matrices  discussed  above  for  the  design 
of  minimum-time  observers. 

2.3  Nagata's  Method  [8] 

The  complete  observability  of  the  linear  discrete 
system: 


x (k+1)  =  Ax (k)  +  Bu ( k) ;  y(k)  =  Cx(k) 


(1-1) 


. 
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implies  that  the  rank  of  the  matrix: 


[C'  I A'C  '  I  .  .  .  . 

. | A,n  1C ' ] 

(2-9) 

is  n.  This  means 

that  there  exists  a 

set  of  linearly 

independent  column 

vectors [9] : 

ci'A'ci . 
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where  (i  =  l,2,...,m)  are  the  i  row  vector  of  C  and 
a.  are  the  Kronecker  invariants  of  the  pair  (A'fC')/ 


and 


m 

l  ai  =  n 

i  =  l 


(2-11) 


The  matrix  S  defined  as: 


ci 

c-^A 

■  CT-i  —  1 

c^A  1 
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c2 

C^2'1 
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c 1 Aam_ 1 
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(2-12) 
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becomes  nonsingular  (i.e.  invertible)  where 

j 

Pj  =  l  ai  (j  =  1,2, ... ,m)  and  ym  =  n  (2-13) 

i=l 


It  is  convenient  to  express  the  matrix  S  1  in  the  follow¬ 
ing  manner. 


s  P  IPoil***lp9rr  I  •  •  •  I  Pm  rr  ] 
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2a. 


ma 


(2-14) 
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where  (i  =  1,2, ...,m,  j  =  1,2, ...,0^) 

column  vectors  of  the  matrix  S  1. 


denote  the 


Next,  define  the  matrix  T  as: 


T  [pla.J  Apla.J  *  *  *  I  A  1  pla]JP2a2 
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„a9-l 

A  2  p 
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column  y 


1 


column  y~  column  y 
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(2-15) 


It  is  easily  seen  that  the  matrix  T  is  also  nonsingular 
[9].  Then  rearrange  the  column  vectors  of  T  to  obtain 
the  following  matrix  W: 


W  =  [W.,  I  W„  |  .  .  .  I W  ]  (2-16) 

1  1  2  1  1  a 
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where 


WT  =  [w, , | w • 9 | . . . I w.  ] 
i  11 1  1  1  im. 


(2-17) 
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i-  =  Aaj  1  p  (j  =  1,2, 

J  j 


(2-18) 


and 


a  =  Max  o.  (i  =  l,2,...,m) 
i  1 

=  the  observability  index  [3] 


(2-19) 


If  i  >  0^  +  1,  then  the  particular  column  vectors  w^ 
do  not  appear  in  the  matrix  T/T  .  It  is  obvious  by  the 
definition  of  W  that  W  is  nonsingular  and 


m  =  iru  ^m0>  .  .  .  .  >m 
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(2-20) 
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l  m±  =  n 
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(2-21) 


Theorem  3 


We  define  a  matrix  0,  as 


SI  =  A  (In-<j>C) 


(2-22) 


where  <J>  =  W-^(CW^) 


-1 


(2-23) 


then  the  matrix  Q.  is  a  nilpotent  matrix  with  the  index  a 


Proof:  Clearly  T  is  a  Luenberger  transformation  matrix 

Thus  T_1AT  and  CT  have  the  form: 
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ot .  .  and  3  •  n  ( i  —  l,2,»..,m,  j  —  l,2,...,m,  £ 

1.J  J  J6 

denote  the  possible  nonzero  elements.  Since 


1,2,..., 
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W  is  obtained  by  simply  rearranging  the  column  vectors 
of  the  matrix  T, 


T 


-1 
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m 


(2-25) 


where 


matrix . 


are  the  y .  th  column  vectors  of  the  nxn  unit 
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y^th  row  (i  =  l,2,...,m) 


(2-26) 


Hence 


T  1W1 
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(2-27) 
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Thus 

T_1  ( I  — <f)C)  T  =  diag 

(R1 

,R2, . . . ,Rm) 

(2-28) 

where  the  o^xc^  matrices  (i  =  l,2,...,m)  are  of  the 
form: 


a .  -1 

l 
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(2-29) 
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and 


T  1QT  =  T  1A(In-4>C)T 


d  i  a  g  ( '  *  *  *  /  ^rri ^ 


(2-30) 


where  the  c^xo^  matrices  (i  =  l,2,...,m) 


D. 
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I 

i 

t 

H  0 
t 
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(2-31) 


It  is  clear  that  since  the  matrix  T  is  a  transpose 

of  the  nilpotent  Jordan  canonical  form  with  the  index 
G/  ft  is  a  nilpotent  matrix  with  the  index  g. 

Furthermore,  the  matrix  ( I n“ 4)C ) A ( In-cj)C)  is  a  nil- 
potent  matrix  with  the  index  o-l  since  the  multiplica¬ 
tion  of  eqn.  (2-28)  by  eqn .  (2-30)  gives: 


(In-(f)C)  ftT 


diag  (N^,^ 


,N  ) 
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(2-32) 


where  the  g^xg^  matrices  1NL  (i  =  l,2,...,m) 


(2-33) 
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The  matrix  (In~(j)C)  with  rank  n-m  is  a  projection 
of  V  onto  V 2  along  where  and  V2  are  the  subspaces 
of  the  n  dimensional  Euclidian  space  V,  that  is 

V  =  Vx  ©  V2  (2-34) 

and  C  e  V±  (2-35) 

Thus  if  the  rank  of  the  matrix  [C'|j']  is  n  so  is  the 
rank  of  the  matrix  [C'  | T  * ]  where 

T  =  j(In-<|>C)  (2-36) 

Theorem  4 

The  matrix  E  satisfying 

ET  =  In“4>C  (2-37) 

leads  to  a  reduced  order  minimum-time  observer  which 
takes  the  form: 

z (k+1 )  =  F  z ( k )  +  Gy (k)  +  Hu(k)  (2-38) 

where  F  =  TAE  (2-39a) 

G  =  TA<J>  ( 2-3  9b) 


H 


TB 


(2-39c) 
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proof:  The  solution  to  the  homogeneous  estimation 

error  equation: 


e (k+1 )  =  Fe(k) 


(2-40) 


is  given: 


e (k)  =  Fke(0)  (2-41) 

Since  the  matrix  T  is  of  full  rank,  there  always  exists 
an  nxl  vector  v(0)  such  that 

e ( 0)  =  Tv ( 0 )  (2-42) 

Thus  substitution  of  eqns.  (2-36),  (2-37)  and  (2-42) 

into  eqn.  (2-41)  gives: 

e  (k)  =  T(AET)kv(0) 

=  J(In-<|>C)  [A(In-(f.C)  ]kv(0)  (2-43) 

Since  the  projection  matrix  In-cf)C  is  idempotent  (i.e. 

( In-c|)C)  ( In~(f)C)  =  In~({)C)  ,  we  can  write  eqn.  (2-43)  as: 

e  (k)  =  J[  (In-(j)C)A(In-(t)C)  ]kv(0)  (2-44) 

Thus  the  error  in  the  estimate  converges  to  zero  in  at 


■ 
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most  G~1  steps  since  ( I  —  (|>C ) A ( I  —  4>C )  is  a  nilpotent 
matrix  with  the  nilpotency  index  a-1 .  In  other  words, 
the  observer  governed  by  eqn.  ( 2— 38 )  produces  an  exact 
state  estimate  of  the  plant  in  at  most  a-1  steps. 

In  particular,  if  J  is  chosen  such  that 


=  [  4>  |E  ] 


-1 


(2-45) 


where 


E  =  lpla1'APla1 


a-i  —2  |  | 

A  p-,  p~„  . 
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i  a  o  —  2 
.  |  A  z  p 
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a  -2 

A  m  p„„  ] 


ma 
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(2-46) 


Then  T  =  J(I  -<J>C)  =  J 


(2-47) 


ET  =  In-(j)C 


(2-48) 


The  observer  matrix  thus  has  a  simple  structure  as; 


F  =  TAE  =  diag  (F1 r F2 ' * • * ' Fm) 


(2-49) 


where 


Fi 


o  : 

- 1  o 

i 
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a 


-1  i 


(i  1 , 2 ,  .  .  .,m) 


(2-50) 


. 


and 


G  =  TA(j>  =  [gij] 


(i  1 , 2 , . . . , y^  1 , y^+1 
j  —  1*2,...,  rn) 


/ 


(2-51) 


m 


where 

gij  =  i  au 
i=i 

y.  . 

13 

and 

Y11  -  --  Ylm 

o 

/ 

/ 

rH 

Y12  Y2m 

1  1 

1  1 

1  ' 

v  _ y 

ml  'mm 

321  \ 

i  \ 

i  \ 

®ml  1 

(2-52) 


(2-53) 


2.4  Porter's  Method  [10] 

In  general,  a  change  of  coordinates  of  the  system 
to  a  canonical  form  provides  a  simple  structure  of  the 
system  still  possessing  all  the  essential  characteris¬ 
tics  which  can  be  easily  recognized.  The  observation 
problem  can  be  facilitated  by  the  Luenberger  canonical 
form,  which  reduces  the  m-output  system  into  m  separate 
single-output  systems.  Thus  with  the  Luenberger 
canonical  matrices  we  are  able  to  treat  the  minimum¬ 
time  observation  problem  more  systematically. 

The  Porter's  method  which  is  described  in  this 
section  uses  the  Brunovsky  [13]  canonical  form  for  de¬ 
signing  a  minimum-time  observer.  This  canonical  form 
is  identical  to  the  Luenberger  canonical  form. 
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Let  the  triple  (C,  A,  B) 
canonical  form,  that  is 

A  =  T_1AT 

B  =  T_1B 

C  =  CT 

and  x(k)  =  T  ^x(k) 


be  in  the  Luenberger 

(2-24a) 

(2-54) 

( 2-24b) 

(2-55) 


Then,  with  the  simple  structure  of  the  matrices  C  and 
A  we  can  describe  the  system  in  the  following  manner. 


x1 (k+1) 


x2(k+1) 


x  (k+1) 
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1 
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+  y  b  .u. 
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\ 

1 

m  i 

p  ! 

y  a  1  .X  (k) 

.  L ,  u  1  u  . 

1=1  Mm  Mi 
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+  xPl-i(k) 
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( 2-56a) 
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yl(k)  =  x,,  <k) 


y2(k)  =  e21x  (k)  +  x  (k) 


( 2-56b) 


y  (k) 

J  m 


m-1  ' 

2  6miV  <k)  +  x 

1  =  1  1 


y 


(k) 


m 


where 


x  (k)  = 


x1  (k) 

Y1  (k) 

u1  (k) 

x2  (k) 

i 

i 

,  y(k)  = 

y2(k> 

l 

/  u(k)  = 

u2(k) 

i 

i 

K  (k) 

_  m 

i 

1 

y  1  (k) 

J  m 

i 

i 

u'  (k) 
P 

(2-57) 


and 


B  = 


bir-~  b 

b^., - b 
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ymP 


(2-58) 


Since  the  state  variables  x.  (i  —  y, , , . . . . u  ) 

i  12  m 

are  determined  through  the  measurement  of  the  outputs 
y(k),  another  n-m  dimensional  dynamic  system  (observer) 
described  by: 
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m 
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(2-59) 
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where  (i  -  j  =  1,2,,.. ,m)  are  the  elements 

of  the  mxm  matrix: 
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(2-60) 


thus  produces  an  exact  estimate  of  the  state  variables 
x  .  (i  =  0,1,.  ..,m-l,  j  =  1, 2,...,ai+1-l,  yQ  =  0)  in 
at  most  j  steps.  Hence  the  observer  yields  the  inac¬ 
cessible  state  vector  in  at  most  a-1  steps. 
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The  representation  of  eqn.  (2-59)  in  the  matrix  form 


is : 


z(k+l)  =  Fz (k)  +  Gy (k)  +  Hu(k) 
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where  the  a.-l  x  a.-l  matrices  F.  (i  =  l,2,...m)  have  the 

3.  1  1 

form: 


F.  = 
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0 

- 1  0 
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(2-62) 


and 
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gij  (i  “  1-2, ...y-L  l,p1+l . ym-l, 

—  1 , 2 , . . . ,m) 


3 


(2-63) 


Comparing  eqns.  (2-62),  (2-63)  with  eqns.  (2-49), 

(2-51)  it  can  be  easily  seen  that  the  observer  governed 
by  eqn.  (2-59)  is  a  particular  case  of  eqn.  (2-38) . 

Computer  simulations  to  illustrate  the  performance 
of  Nagata's  and  Porter's  minimum-time  observers  are 
presented  in  Chapter  5. 
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CHAPTER  3 


THE  MINIMUM  COST  OBSERVER 

3.1  Problem  Formulation 

Ideally,  we  would  like  to  design  an  observer 
which  estimates  the  plant  state  vector  without  any 
error.  However,  this  cannot,  in  general,  be  achieved 
since  the  initial  condition  on  the  unmeasurable  plant 
state  variables  is  not  known.  Thus  it  is  desirable, 
as  a  compromise,  to  design  an  observer  which  estimates 
the  unmeasurable  plant  state  as  closely  as  possible 
at  every  step.  In  practice,  in  order  to  realize  this, 
we  often  formulate  a  mathematical  performance  index 
which  reasonably  describes  the  desired  goal  and  then 
minimize  this  particular  performance  measure.  A  use¬ 
ful  performance  index  in  the  case  of  discrete  observers 
is  the  following  quadratic  function  of  the  state 
estimation  errors  (see  eqn.  1-25) : 

oo 

j  =  £  e'(k)Qe(k)  Q  =  Q*  >0.  (1-25) 

k=0 

where  e(k)  is  as  defined  in  eqn.  (1-23) .  A  minimization 
of  this  criterion,  suppresses  any  large  deviations  from 
the  state  of  the  plant  and  thereby  forces  the  observer 
to  produce  an  estimate  as  close  as  possible  to  the  un¬ 
measurable  state  of  the  plant. 
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In  the  following  sections,  a  design  procedure 
for  a  minimum-cost  observer  (minimum  in  an  average  sense) , 
developed  by  Gourishankar  and  Kudva  [14]  is  presented. 

3.2  Optimality  in  an  Average  Cost 

Again  the  system  under  consideration  is  assumed 

to  be 


x (k+1)  =  Ax (k)  +  Bu (k) ;  y(k)  =  Cx(k)  (1-13) 


and 


C  =  [I  :  0]  (1-14) 

m  • 

An  observer  [4]  reconstructing  the  unavailable  part  of 
the  state  vector,  w,  can  be  designed  as  follows. 

z (k+1)  =  Fz (k)  +  Gy (k)  +  Hu(k)  (1-20) 


where 


F  ~  A22  +  LA12 


(l-21a) 


G 


FL  +  A21 


+  LA 


11 


(l-21b) 


=  B2  +  LB1 


H 


(l-21c) 


■ 
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A  = 

"Au 

1  A 
i  12 

i  "  ■ 

^21 

^22 

m 

n-m 

I 


m 

n-m 


(1-16) 


and  the  elements  of  the  matrix  L  are  the  free  design 
parameters  subject  to  the  stability  of  the  observer. 

Then  the  estimate  w(k)  of  w(k)  is  given  by 

w  (k)  =  z (k)  -  Ly(k)  (1-22) 

Thus  the  estimation  error: 


e(k)  =  w(k)  -  w(k)  (1-23) 

satifies  the  homogeneous  difference  equation: 

e(k+l)  =  Fe (k)  (1-24) 

The  quadratic  function  (1-25)  becomes 

00  i 

J  =  l  [F  e  ( 0 ) ]  'QF  e ( 0 )  (3-1) 

k=0 


If  we  let 


00  v  k 

S  =  l  (F')  QFK 

k=0 


(3-2) 


' 

. 

' 

. 


and  assume  F  to  be  a  stable  matrix,  it  immediately 
follows  that  the  matrix  S  is  the  solution  to: 

F'SF  -  S  +  Q  =  0  (3-3) 

Therefore,  the  quadratic  function  is  expressed  by 

J  =  e  '  (0)  Se  (0) 

=  [w  ( 0 )  -  w(0)]  ’S[w(0)  -  w  ( 0 )  ]  (3-4) 

=  [z  ( 0 )  -  Ly  ( 0 )  -  w(0)]'S[z(0)  -  Ly  (0)  -  w(0)] 

where  S  is  the  positive  definite  matrix  satisfying  eqn. 
(3-3) . 

Further,  if  the  initial  condition  on  the  observer 
state  is  chosen  to  be 

z  ( 0 )  =  Ly ( 0 ) 

so  that 

w  ( 0 )  =  0 

Eqn.  (3-4)  simply  becomes 

J  =  w' (0)Sw(0)  (3-7) 

Since  w(0)  is  unknown,  the  explicit  dependence  of  the 
performance  index  on  w(0)  should  be  avoided  in  determining 


(3-5) 

(3-6) 


' 


, 


■ 


■ 


an  optimal  observer  matrix  F. 

A  simple  way  [1]  to  eliminate  this  dependence 
is  to  consider  the  average  of  the  performance  obtained 
for  a  linearly  independent  set  of  values  for  w(0) . 
Mathematically  this  is  equivalent  to  assuming  w(0)  to 
be  a  random  vector  uniformly  distributed  on  the  surface 

of  the  n-m  dimensional  unit  sphere.  Then  the  expected 

/*\ 

value  of  J  of  the  performance  index  is  given  by 

^  n-m 

(n-m)  J  =  l  e!Se.  =  tr(S)  (3-8) 

i=l 

where  the  vectors  e^  (i  =  1,2,..., n-m)  are  the  i  th 
columns  of  the  (n-m)  x  (n-m)  unit  matrix  and  S  is  as 
defined  earlier. 

This  average  performance  index,  which  is  independent 
of  the  initial  state,  enables  us  to  obtain  an  optimal 
observer  in  an  average  sense. 

3.3  Optimal  Observer  Design 

The  optimal  design  problem  is  thus  converted  to  one 
involving  the  selection  of  the  matrix  L  which  minimizes 
tr(S),  subject  to  the  constraint  eqn.  (3-3).  However, 
in  general,  this  problem  leads  to  a  solution  which 
involves  the  inversion  of  singular  matrices.  Thus  in 
order  to  avoid  this  difficulty,  the  performance  measure 
tr(S)  is  augmented  with  the  term  atr(L'SL),  a>0  and  the 


J  ft  |  £  J  ,  ^  |  ,  I  I  ^  H  I  I  J't  |l 


. 

■ 

f‘-  "  '.  1  ^ 


•' 

. 


following  modified  criterion  is  minimized  with  res¬ 
pect  to  the  matrices  L  and  S: 

tr(S)  +  a  tr(L'SL)  (3-9) 


subject  to  the  constraint  equation: 


(a22  +  la12) 's(a22  +  la12)  -  S  +  Q  =  0  (3-10) 

This  problem  can  be  formulated  as  an  unconstrained 
minimization  of  the  augmented  criterion: 

j±  =  tr  [s  +^{(a22+  la12)'s(a22  +  la12) 

-  S  +  Q}]  +  a  tr[L'SL]  (3-11) 


where  ft  is  a  symmetric  positive  definite  Lagrange 
multiplier  matrix. 

It  has  been  shown  [14]  that  the  solution  to  this 
problem,  which  also  ensures  the  stability  of  the 
observer,  possesses  limiting  values  as  a  -*■  0+  and  the 
limiting  value  of  L  is: 


o 


-  A00C3 
22  o 


A  1 

a12 


<A12^o 


*  + 
A12'> 


(3-12) 


where  ftQ 


* 


is  the  positive  definite  solution  to 


- 


-  '  ■ 


. 


N 


' 
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22^o  A2 2 ' 

A22^o 

* 

12^0  A22  ' 

+  I 

n-m 

12  o  12 


(3-13) 


•(If  ^ 

The  determination  of  LQ  and  from  eqns .  (3-12) 

and  (3-13)  can  be  broken  down  into  two  cases: 

a)  the  matrix  is  of  full  rank,  and 

b)  A^2  is  not  of  full  rank 

Case  a)  A^2  is  of  full  rank 


i)  if  n  >  2m,  then,  (A^^o  Ai2^  nonsin<?uiar 

* 

and  the  matrix  can  be  directly  obtained  by  solving 

the  Riccati  equation: 


^o  A22^o  A22 '  A22^o  A12 '  (A12^oA12 ' ^ 


A, A09 '  +  I 
12  o  22  n— m 


(3-14) 


and  L  is  to  be 
o 


Lo  “  A22^o  A12 '  (A12^o  A12  ) 


(3-15) 


ii)  if  n  ^  2m  by  using  the  matrix  inversion  lemma 
it  is  easily  seen  that: 


^  A12 

( al  + 
m 

a-  ' 

a12^ 

-1  -1 

A12 

(A12 ' A12 

+  aft 

) 

A12 

M-l 


(3-16) 


' 
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Hence,  taking  the  limit  as  a  -*0+  eqns.  (3-12)  and 
(3-13)  become 


'A 


-1 


(3-17) 


and 


I 

n-m 


(3-18) 


Case  b)  A12  is  not  of  full  rank 

* 

In  this  case  the  solution  of  eqn.  (3-13)  for 
is,  in  general,  not  straightforward  except  for  lower- 
order  systems.  The  following  numerical  procedure  has 
been  proposed  [14]: 

i)  With  an  arbitrary  small  positive  value  of  a 
solve  the  Riccati  equation: 


ft  =  A^ftA^'  -  A00ftAn0'  (al_  +  A12fiAi2 ' ^ 


M-l 


‘22  2  2 


22  12 


m 


A,  ~ftA  '  +  I 
12  22  n-m 


(3-19) 


for  a  positive  definite  matrix  £2, 

ii)  then  evaluate 

4)  =  A22^A22'  -  a22^A12'  (A12^A12  * 

A12^A22 '  +  In-m 


+ 


(3-20) 


using  the  value  ft  obtained  in  step  (i) 

iii)  if  ||  n  -  4>  ||  <  e  where  e  is  a  preselected  small 

*  * 

positive  constant,  set  ftQ  —  ft  and  compute  LQ  from 


■ 


' 


■ 
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eqn.  (3-12);  otherwise  decrease  the  value  of  a  and 

repeat  the  above  procedure. 

* 

Once  the  matrix  Lq  is  obtained,  then  the  design 
of  the  optimal  observer  is  completed  by  computing  the 

"Jc  "fa  7^ 

optimal  observer  matrices  F  ,  G  and  H  from  eqn.  (1-21) 
and  setting  the  initial  condition  on  the  observer  state 
z (0)  =  LQ*y (0) . 


Example : 

Consider  a  fifth-order  linear  discrete  system 

with 


1 

0 

1 

0 

1 

—  — 

0 

0 

1 

1 

0 
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B  = 

0 

0 

0 

1 

1 

1 

0 

0 

1 

0 

0 

1 

0 

0 

0 

1 

1 

0 

1 

and 


C 


1  0  0  0  0 
0  10  0  0 


Here , 


A 


22 


1 

0 

1 


1 

0 

1 


1 

1 

0 


10  1 
10  1 


rank  (A^) 


1 


. 

and  let 


w12  w13 
w22  w23 

^23  w33 


then , 

A12^oA12'  = 

and 


1  1 
1  1 


(A12noA12,)+  - 


4  (oo 


t  1 


+  2  co 


+  ud 


W11  +  2w13  +  ^33'  wll  +  2w13  +  W33 


W11  +  2a3l 3  +  W33'  W11  +  2aj13  +  ^33 


w12 

w13 


Thus,  the  solution  to  eqn.  (3-17)  for  is  given 

as : 


From  eqn 


2.49 

-0.25 

1.74 

0.25 

1.62 

-0.87 

1.74 

-0.87 

3.61 

16)  , 

• 

o 

I 

• 

o 

1 

I 

o 

• 

tO 

00 

1 

o 

• 

to 

00 

-0.16 

1 

o 

• 

I-1 

Ch 

so  that  from  eqn.  (1-21)  the  optimal  observer  matrices 
are 


* 

F 


* 

G 


0.12 

1 

0.12 

-0.56 

0 

0.44 

0.67 

1 

-0.33 

_ 

-0.09 

-0.09 

-0.45 

0.55 

0.36 

0.36 

0 

1 


It  will  be  shown  in  the  next  chapter  that  the 
optimal  observer  design  procedure  described  in  the  pre¬ 
ceding  sections  can  be  considerably  simplified  if  the 
system  is  represented  in  a  suitable  canonical  form.  In 
such  a  case,  a  direct  solution  to  the  matrix  Riccati 
eqn.  (3-13)  can  be  obtained  whether  the  matrix  A^2  is 
of  full  rank  or  not.  It  will  also  be  shown  that  the 
resulting  observer  is  not  only  a  minimum-cost  observer 
but  also  a  minimum-time  observer. 
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CHAPTER  4 


MINIMUM-TIME  MINIMUM-COST  OBSERVER 


4.1  Canonical  Representation  for  Observer  Design 

In  the  previous  chapter,  a  procedure  was  presented 
for  the  design  of  an  observer  such  that  a  quadratic 
function  of  the  state  estimation  error  was  minimized. 

In  this  chapter  it  will  be  shown  that  this  design  pro¬ 
cedure  can  be  considerably  simplified  by  the  choice  of  a 
suitable  canonical  representation  for  the  system.  In¬ 
terestingly  enough,  the  resulting  observer  is  found  to 
also  possess  the  minimum-time  state  estimation  property. 

Let  the  discrete  system  (1-1)  be  represented  by 


(4-1) 


x (k+1 )  =  Ax (k)  +  Bu(k) ;  y(k)  =  Cx(k) 


in  the  Luenberger  canonical  form.  This  assumption 

can  be  made  without  any  loss  of  generality.  It  follows 

that 


( 2-24a) 


C  =  CT 


(2-24b) 


B  =  T  1B 


(2-54) 


and 


(2-55) 


44 


. 


5 


. 


' 

The  observer  design  is  facilitated  by  introducing 
a  suitable  rearrangement  of  the  plant  state  variables. 

This  is  achieved  by  the  following  coordinate  transfor¬ 
mation  [15]  : 

x(k)  =  Px(k)  (4-2) 


This  transformation  enables  the  system  in  the  new 
coordinates  to  retain  the  simplicity  of  the  essential 
structural  feature  in  the  matrices  A  and  C,  where 
i)  the  nxn  matrix  P  is  given  by 


P  = 


(4-3) 


ii)  the  (n-m)xn  matrix  D  is  given  by 


D  =  diag  (D^ ,D2 # • • • /Dm)  (4-4) 

where  the  (o^-l)xa^  matrices  (i  =  l,2,...,m)  are 
given  by 


and  ck  (i  =  1,  2,...,m)  are  the  Kronecker  invariants  of 
the  pair  (A ' , C ' ) . 


- 

' 


■ 


; 
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The  transformed  form  of  eqn.  (4-1)  can  be  written 


as : 


x (k+1)  =  Ax(k)  +  Bu(k);  y (k)  =  Cx(k)  (4-6) 


where : 


i) 


A 


PAP 


-11  !  -12 


n-m 


} 

} 


m 

n-m 


(4-7) 


(4-8) 


C  (i  =  1,2 

of  C 


,m)  are  the  y^th  column  vectors 


(2-13) 


11 

1 

g12 

i 

i 

- glm 

1 

1 

1 

Ux-11 

i 

V12 

I 

1 

gy1~lm 

y1+11 

^+12 

gy1+lm 

9u  -11  gu_-12 


m 


- cr 


^m 


^m 


-lm 


(4-9) 


' 
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m 

gij  (l  =  1,2 

j  =  1,2 


,y1-l,y1+2 

,m) 


(2-63) 


A22  =  diag  (E]_ ,  E2  ,  .  .  .  ,  EJ 


(4-10) 


the  (a^  1)  x  (a^-1)  matrices  M_^  are  given  by 


0 


(i  1,2,..., m) 


(4-11) 


ii)  C  =  CP  1  =  £lmj oj 


iii ) 

Ji_ " 

) 

B  =  PB  = 

f 

.®2 

) 

(4-12) 


(4-13) 


and 

iv)  the  state  vector  is 


(4-14) 


y(k)  being  the  accessible  output  vector  and  w(k) ,  the  un¬ 
measurable  part  of  the  state  vector. 


■ 
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4.2  Optimal  Observer 

Since  the  system  equation  (4-6)  is  the  same  in  the 
form  as  eqn.  (1-13) ,  we  can  follow  the  design  procedure 
described  in  the  previous  chapter  to  obtain  an  optimal 
observer  for  estimating  w(k).  This  observer  is  a  minimum- 
cost  observer  in  an  average  sense  as  defined  in  Chapter  3. 

z(k+l)  =Fz(k)  +  G  y(k)  +Hu(k)  (4-15) 


where 


F  “  -22  +  Lo  -12 


(4-16a) 


G  =  FLq  +  A21  +  Lq  A±1 


( 4-16b) 


H  =  B2  +  Lq  B_1 


( 4-16c) 


L0  -  ”A22^0  ^—12^0  —12  ^ 


(4-17) 


and  is  the  positive  definite  solution  to  the  Riccati 

equation: 


Q  =  A22^A22'  -  A 2 2 fiA_1 2 '  (A12^12,}  -12^22'  +  In-m 


(4-18) 


and  the  initial  condition  on  the  observer  state  is  chosen 


as 


(0)  =  L0  y (0) 


(4-19) 


< 


- 
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The  design  procedure  thus  requires  the  solution  to 
the  Riccati  eqn.  (4-18) .  We  shall  consider  solving  eqn. 
(4-18)  by  the  following  iterative  algorithm: 


fii+l  — 22^i— 22 '  — 22^i— 12 '  (-12^i-12') 


•  \  + 


A, • A~  ~ 1  +  I 

—12  i—22  n-m 


(4-20) 


with  =  I 

0  n-m 

In  view  of  the  simplicity  of  the  structure  of  the 
A12  and  A_22  /  it  can  be  easily  shown  that 

i)  A22a-1  =  0  (4-21) 

ii)  A22j  (A22')j  =  diag  (M1(M2, . . . ,Mm)  (4-22) 

^  —  If2f*»*/C  2 


where  the  (c^-1)  x  (c^-1)  matrices  Mi  are 


i  =  1,2, 


,m 


and 


-22-12 


(4-23) 


iii) 


I 


0 


(4-24) 


' 


(4-25) 


with  the  particular  structures  of  A22^  (a22')^  and 
A12,  it  is  also  easily  seen  that 


A 


22 J  (— 22  '  >  ^  *12'  =  ^12’  (j  =  1-2,. ..,0-2) 


Thus  using  eqn.  (4-24) 


-22^  (-22  '  ^  —12*  “  0 


(4-26) 


By  using  eqn.  (4-25)  the  sequence  of  can  be  expressed 
as  follows: 


£20 

^1 


=  I 


n-m 


-22^22  +  In-m 

(—22 ) 2 (—22 ' ) 2  +  -22-22'  +  In-m 


(4-27) 


fii  =  (A^)1^^')1  +  (A--)1  X(A9  -)1  1  +  ... 


. . •  +  A~0Aon 1  +  I 

22  22  n-m 


Since  A22a  ^  =  0,  it  is  clearly  obvious  that  this 
algorithm  terminates  at  the  (a-2)th  step  to  give 


a-2 


=  °o-2  -  .1  (^22>3^22'>3  +  V 

D=1 


m 


(4-28) 


The  matrix  can  now  be  directly  computed  from 

eqns .  (4-22)  and  (4-28)  and  is  obtained  as: 


' 


. 


' 


* 

= 


°r1 


0 


0 


0 


\ 


°2~1 


0 


\ 


\ 


\ 


0 


0 


\ 


c  -1 
m 


(4-29) 


4.3  A  Comparison  with  the  Minimum-Time 

* 

With  the  value  of  in  eqn.  (4-29) ,  we  have 


—22^0  -12  '  0 


(4-30) 


and  hence  from  eqn.  (4-17) 


0 


(4-31) 


Thus  the  optimal  observer,  in  an  average  sense, 
obtained  fromeqns.  (4-15),  (4-16),  (4-18)  and  (4-31) 
is  simply  expressed  as: 

z(k+l)  =  A22z(k)  +  A21y(k)  +  B2u(k)  (4-32) 

with  z(0)  =  0 

and  the  estimate  w(k)  of  w  is  given  by 

w(k)  =  z  (k) 

This  minimum-cost  observer  being  independent  of 
the  matrix  Q,  reveals  several  interesting  features 
both  in  the  design  procedure  and  in  itself.  By  in¬ 
troducing  a  particular  canonical  representation  for 
the  system  (1-1) ,  the  design  procedure  is  considerably 
simplified  in  comparison  to  that  discussed  in  the 
previous  chapter.  The  procedure,  here,  involves 
merely  selecting  the  appropriate  submatrices  from  the 
pair  (A,B) .  Comparing  eqns.  (2-62)  and  (2-63)  with 
eqns.  (4-9)  and  (4-10)  the  minimum-cost  observer  obtained 
in  this  chapter  is  identical  to  the  minimum-time  observer 
obtained  by  Porter's  method.  Thus  the  resulting 
observer  produces  an  errorless  estimate  of  the  plant 
state  vector  in  the  minimum-time  [10]  as  well  as  mini¬ 
mizes,  in  an  average  sense,  the  performance  index.  We 


< 


i 


- 


. 


^  I 


' 


- 


shall  refer  to  it  as  a  minimum-cost,  minimum-time 
observer . 

Simulation  results  to  demonstrate  the  performance 
of  this  observer  are  presented  in  Chapter  5. 


4.4  Example: 

Consider  a  fifth-order  linear  discrete  system 

with 
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C  = 
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The  Luenberger  canonical  form  is  then  given  as: 
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0 

•  '  n 


■ 

c  = 


0  0  0  1  0 
0  0  0  1  1 


with  =  4  and  =  1 


Thus  the  transformation  matrix  P  having  the  form: 


0  0  0  1  0 
0  0  0  1  1 
1  0  0  0  0 
0  10  0  0 
0  0  10  0 


changes  the  coordinates  such  that 
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1 

B  = 

0 

1 

1 

0 

0 

1 

0 

-2 

3 
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and 
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1  0 
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Here , 

—22 


0  0  0 
10  0 
0  10 


0  0 
0  0 


1 


0 
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•k 

Thus,  the  solution  to  eqn.  (4-18)  for  ftQ  is  given  by 
iterative  algorithm  (4-20)  as  follows 


ft 


10  0 
0  10 


1 


10  0 
0  2  0 


2 


10  0 
0  2  0 


From  eqn  (4-17) 

* 

Lc  =  0 
so  that  from  eqn 


(4-16)  the  optimal  observer  matrices  are 


and 


CHAPTER  5 


SIMULATION  RESULTS 


5.1  Introduction 

In  this  chapter,  the  objective  is  to  present  com¬ 
puter  simulation  results  to  compare  the  effectiveness 
of  the  three  observers  discussed  in  the  preceding 
chapters.  This  comparison  will  be  made  in  two  ways. 

The  first  test  will  involve  the  comparison  of  the 
estimates  generated  by  each  of  the  three  observers 
of  the  actual  states  of  a  force  free  dynamic  plant  in 
an  open-loop  configuration.  In  the  second  test  the 
observers  will  be  incorporated  in  a  closed  loop  system 
along  with  a  feedback  controller  designed  to  minimize  a 
quadratic  performance  criterion,  assuming  complete 
state  feedback. 

In  order  to  obtain  meaningful  comparisons  the 
same  plant  is  used  in  all  the  tests.  The  plant  is  of 
fifth  order  with  2  outputs.  It  will  be  assumed  that 
3  of  5  states  are  unmeasurable.  A  third  order  observer 
will  be  needed  to  estimate  these  variables.  The  plant 
matrices  are 


A 


0  10  0  0 
10  10  0 
0  0  110 
10  110 
0  0  0  0  1 
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B  = 


1 

0 

0 

0 

1 


C  = 


12  1-1 
14  4  2 


The  initial  value  of  the  state  vector  x  will  be  assumed 
to  be 


x(0) 


5,2  Open-loop  Test 

Referring  to  Chapter  3  and  4  the  initial  conditions 

* 

on  the  states  of  Observers  C  and  TC  are  computed 


★ 

For  the  sake  of  convenience,  the  minimum  observer  de¬ 
signed  by  Nagata,  et  al  will  be  referred  to  as  Observer  T. 
The  minimum-time  observer  of  Porter  and  the  minimum-time 
and  minimum-cost  observer  designed  by  the  author  which  are 
essentially  the  same  as  Observer  TC  and  the  minimum-cost 
observer  designed  by  Gouri shankar  and  Kudva  Observer  C. 
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to  be 

zc ( 0)  =  [23.31,  31.46,  50.61]' 

and 

ZTC ( 0 )  =  [0,  0,  0]' 

Since  the  initial  value  of  the  state  vector  of  Observer 
T  is  not  specified  in  the  design  procedure  the  initial 
state  is  arbitrarily  chosen  to  be 

zT(0)  =  [1,  -4,  3]' 

The  corresponding  composite  open-loop  system  responses 
are  shown  in  Fig.  2  in  terms  of  the  error  between  the 
estimates  and  the  actual  values  of  the  state. 

It  may  be  useful  to  point  out  the  characteristic 
properties  in  behavior  of  the  system. 

1)  Interestingly  enough,  the  estimation  error  of 

the  system  for  Observer  C  converges  close  enough  to  zero 
in  one  step  less  compared  to  the  other  observers  al¬ 
though  the  error  does  not  vanish  in  finite  steps,  and 
is  accompanied  by  large  overshoots  in  all  the  state 
variables . 

2)  Also  as  expected,  Observers  T  and  TC  start  to  yield 
the  errorless  state  of  the  plant  in  a-1  step  which  is 

2  step. 

3)  Comparing  the  magnitude  of  the  overshoots  of  the 
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Figure  2  (a)  :  Open'-Loop  State  Responses  for 
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Figure  2(b):  Open-Loop  State  Responses  for 
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Figure  2(c) :  Open-Loop  State  Responses  for 
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Figure  2(d):  Open-Loop  State  Responses  for 
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Figure  2(e):  Open-Loop  State  Responses  for 


transient  responses  with  Observers  T  and  TC,  the 
estimate  of  Observer  TC  traces  more  faithfully  the 
actual  state  of  the  plant,  although  the  trajectories 
of  the  responses  are  much  similar. 

5.3  Closed-loop  Test 

The  controller  which  minimizes  the  performance  in¬ 
dex  with  complete  state  feedback  is  determined  [14] 
to  be 


K  =  [2.04,  1.22,  4.09,  3.28,  -0.22] 

The  same  values  of  the  initial  states  for  the  observers 
are  set  in  the  closed-loop  system  as  in  the  open-loop 
system.  Fig.  3  shows  the  errors  in  the  closed-loop  re¬ 
sponse.  The  entire  states  are  shown  in  Appendix  C. 

Here,  it  is  possible  to  note  the  similarities 
and  differences  in  the  behaviors  of  the  closed-loop 
systems  and  the  open-loop  systems. 

1)  The  steps  required  for  convergence  close  enough 
to  the  actual  state  are  almost  same  for  all  the 
observers  in  the  closed-loop  systems.  However  the 
error  response  of  Observer  C  has  large  overshoot. 

2)  Due  to  introduction  of  the  minimum-cost  regulator, 
the  estimation  errors  do  not  vanish  in  finite  steps  in 
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Figure  3(a) :  Closed-Loop  State  Responses  for 
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Figure  3 (b) :  Closed-Loop  State  Responses  for 
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Figure  3(c):  Closed-Loop  State  Responses  for 
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Figure  3(d):  Closed-Loop  State  Responses  for 
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Figure  3(e):  Closed-Loop  State  Responses  for 


the  closed-loop  systems  for  Observers  T  and  TC  as  in 
the  open-loop  systems. 

3)  The  behavior  of  the  closed-loop  system  for  Observer 
TC  is  very  similar  to  that  of  Observer  T,  though  the 
system  with  Observer  T  has  a  greater  amount  of  over¬ 
shoot  than  the  system  with  Observer  TC. 
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CHAPTER  6 


CONCLUSIONS 

6.1  Summary  and  Discussions  of  Results 

The  main  work  done  in  this  thesis  can  be  stated 
as;  1)  discussing  the  various  design  methods  developed 
so  far  for  optimal  discrete  observers,  by  which  the 
resulting  observers  minimize  either  of  the  minimum  time 
or  minimum  cost  criteria. 

2)  extending  the  above  methods,  resulting  in  a 
simple  method  which  can  be  used  to  build  an  observer 
minimizing  both  of  the  criteria  at  the  same  time. 

Design  of  a  minimum-time  observer  is  based  in 
principle  on  a  choice  of  a  nilpotentent  matrix  with 
the  minimum  value  of  the  nilpotency  index,  satisfying 
the  observer  equation.  One  method  involves  computing 
the  projection  of  the  n  dimensional  space  of  the  plant 
observability  matrix  onto  the  n-m  null  space  of  the 
matrix  C.  This  projection  is  then  used  to  determine  a 
suitable  transformation  linearly  independent  of  the 
matrix  C,  which  leads  to  a  reduced  order  minimum-time 
observer.  The  minimum  number  of  steps  required  to 
estimate  an  errorless  state  of  the  plant  system  is 
here  uniquely  determined  by  the  observation  character¬ 
istic  of  the  plant,  expressed  in  terms  of  the  observa¬ 
bility  index. 
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While  the  other  method  has  been  developed  through 
the  synthesis  of  the  plant  in  the  Luenberger  canonical 
representation,  resulting  in  the  simplicity  of  the 
structure  of  the  observer,  a  particular  choice  of  the 
transformation  leads  to  the  same  result.  This  shows, 
in  turn,  the  Luenberger  canonical  representation  holds 
in  its  simple  structure  all  the  necessary  information 
of  the  observation  characteristics  of  the  plant  system, 
so  that  it  could  facilitate  to  design  a  minimum-time , 
minimum-cost  observer. 

The  minimum-cost  observer  design  problem  is  some¬ 
what  straightforward  in  comparison  to  the  minimum¬ 
time  observer  design  problem.  The  basic  idea  involved 
in  solving  this  problem  is  to  combine  the  preselected 
cost  and  estimation  error  equations  and  then  convert 
this  into  an  unconstrained  minimization  problem.  The 
main  difficulty  in  this  procedure  lies  in  the  explicit 
dependence  upon  the  initial  condition  on  the  plant  state. 
This  can  be  overcome  simply  by  introducing  an  optimiza¬ 
tion  in  an  average  sense,  so  that  the  dependence  is 
completely  eliminated. 

The  elimination  of  the  dependence  upon  the  initial 
plant  condition  also  indicates  the  independence  of  the 
choice  of  a  transformation  for  the  plant  variables. 

Thus  this  enables  the  choice  of  a  particular  transforma¬ 
tion  so  that  the  whole  design  procedure  is  considerably 


- 


simplified,  which  involves  merely  selecting  the  sub¬ 
matrices  of  the  plant  matrix  in  a  canonical  representa¬ 
tion.  This  resulting  observer  appears  to  possess  two 
properties,  namely  the  number  of  steps  required  to 
obtain  an  errorless  estimate  of  the  plant  state  is 
minimized  and  also  the  cost  in  an  average  sense  is 
minimized.  In  other  words  it  is  a  minimum-time, 
minimum-cost  observer. 

While  a  simple  example  has  been  considered  to 
demonstrate  the  superiority  of  the  minimum-time, 
minimum-cost  observer  to  the  other  observers  discussed 
in  this  thesis,  more  extensive  simulation  and  compara¬ 
tive  studies  need  to  be  carried  out  with  practical 
systems  to  assess  the  universal  usefulness  of  this 
observer.  It  must  be  realized  that  minimization  of 
cost  in  an  average  sense  is  not  the  same  as  minimiza¬ 
tion  of  the  actual  cost,  but  merely  a  bound  on  the  worst 
case  performance  of  the  observer. 

6.2  Suggestion  for  Further  Research 

The  following  is  a  partial  list  of  possible  areas 
for  further  work  on  the  subject  of  observer: 

1)  Presence  of  plant  parameter  variation. 

The  work  done  in  this  thesis  has  been  carried  out 
with  an  assumption  that  the  whole  system  is  completely 
under  fixed-parameter  environment.  However,  in  practice, 
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the  parameters  of  the  plant  are  subject  to  variation 
due  to  several  factors  such  as,  for  example,  change  in 
environment  and  component  ageing.  Since  the  poles  of 
the  optimal  observer  are  located  at  the  origin  on  the 
complex  frequency  plane,  perturbation  due  to  the  varia¬ 
tion  would  not  deteriorate  the  performance  of  the 
observer  considerably.  However,  this  could  delay  the 
convergence  of  the  estimation  error  to  zero.  This 
perhaps  requires  modification  of  the  transformation  so 
as  to  reduce  the  effect  of  the  variation  on  the  observer 
performance,  which  has  to  be  resolved  before  the  design 
method  discussed  in  this  thesis  can  be  used  to  practical 
plants . 

2)  Reduction  in  the  dimension  of  an  observer  in 

control  system. 

In  this  thesis,  the  dimension  of  observers  is 
uniquely  determined  by  the  number  of  the  outputs  of  the 
plant.  However,  in  the  case  that  an  observer  is  in¬ 
corporated  into  a  controller,  the  reduction  in  the  di¬ 
mension  of  an  observer  is  possible,  depending  upon  the 
controllability  and  observability  of  the  plant,  with¬ 
out  any  degradation  of  the  overall  performance.  An 
attempt  to  solve  this  problem  in  a  particular  case  has 
been  reported  in  [10] . 
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APPENDIX  A 


Theorem 

The  complete  observability  of  the  pair  (A,C)  implies 

that 


rank  ( C  '  ,  A '  C  '  ,  .  .  .  ,  A ' n  1C')  =  n 


(A-l) 


that  is,  considering  a  particular  form  of  the  matrix 
C  =  [1,0] , 


rank 


A11  A12 

All2  +  A12A21'A11A12  +  A12A22 


n 


( A-2 ) 


! 

I 


Proof 

Since  the  rank  of  matrices  is  not  changed  by  adding 
to  any  row  linear  combination  of  other  rows,  we  can 
write  (A-2)  as 


rank 


0 


A  A 
A12  22 

! 


=  n 


A12A22 


n-1 


(A-3) 
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Thus  the  matrix  in  eqn.  (A-3)  implies 


rank 


0 


A12A22 


A12A22 


n-1 


n-m 


(A-4) 


Since  the  dimension  of  A22  is  n-m,  by  the  Cayley- 

Hamilton  theorem  we  need  only  include  terms  up  to 
n-m-1 


A12A22 


,  which  gives 


rank  [*12 ’ ,&22 ' A12 


n-m- 


'] 


n-m 


we  complete  the  proof. 
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APPENDIX  B 


We  first 

assume  that  eqn.  (2-6) 

holds.  Then  it 

immediately  follows  that 

Nx, 

=  0 

Nx  =0  - 

—  Nx  ,  = 

0 

1 

P+1 

n-s+1 

Nx2 

| 

=  X1 

Nx  , „  =  x  .  - 

p+2  p+1 

—  Nx  , ~  = 

n-s  +  2 

xn-s+l 

j 

1 

| 

1 

I 

i 

l 

i 

(B-l) 

Nx  , 

=  x  0 

Nx  ,  =  x  ^ - 

-  Nx  ' 

x  „ 

P-1 

p-2 

p+q-1  p+q-2 

n-1 

n-2 

Nx 

=  x  i 

NX  =  X  ,  -j  : - 

-  -  Nx 

x  i 

P 

P-1 

p+q  p+q-i 

n 

n-1 

where 

xi  (i  = 

l,2,...,n)  denotes  the 

i-th  column 

vector 

of  T. 

For  the 

sake  of  simplicity  we 

also  assume 

that 

P  ^ 

q  ^  ....  ^  s 

(B-2) 

We  define 

matrixes  X^  (i  =  1,2, 

.  .  .  ,p)  such 

that 

xi 

=  [xl'xp+l'xp+q+l' • • ’ 

' xn-s+l^ 

X2 

1 

=  [s2'xp+2'-"] 

| 

1 

1 

i 

| 

(B-3) 

P-1 

=  [xp-l'xp+q-l' • • 

X 

p 

=  [VVq"-'' 

If  the  matrix  X±  (i  =  l,2,...,p)  has  £i  columns  the 
assumption  (B-2)  implies  that 


79 


80 


£ 

P 


(B-4 ) 


Thus  the  array  (B-l)  can  be  rewritten  in  the  following 
manner . 


NXX  =  0 

NX2  =  Z1  (B-5) 


where  the  matrix  (i  =  l,2,...,p-l)  consists  of  the 

first  £ .  .  -  columns  of  X- . 

l+l  i 

Next,  we  shall  prove  that  [X^ , X2 , . . . , X^]  (k  = 
l,2,...,p)  constitutes  a  basis  for  the  null  space  of 
N  .  Since  T  is  nonsingular  and  the  vectors  in  (B-3) 
are  simply  a  rearrangement  of  those  in  (B-l) ,  the 
columns  of  [X^, X2 , . . . f X  ]  span  n-dimensional  space  so 
that  a  basis  for  the  null  space  of  N  can  be  found 
by  determining  all  vectors  ou  (i  =  l,2,...,p)  such  that 

Nk  [X  ot,  +  ...  +  X  a  ]  =  0  (B-6) 

_L  _L  r  r 

that  is 


[Xk+lak+l  + 


+  Vp3 


0 


(B-7 ) 
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If  we  multiply  eqn .  (B-6)  by  NP  ^  ^  it  is  easily  seen 

that 


p— 1 

N1  X  a  =  0 
P  P 


(B-8 ) 


Since  the  columns  of  NP  are  part  of  X  the  columns 

hr 

of  NP  Xp  are  linearly  independent. 

Therefore , 


ap  =  0  (B-9 ) 

Similarly,  the  successive  multiplication  of  eqn.  (B-6) 
by  NP  k  ^ ,  nP  ^  ^ ,  . . . ,  N  gives 

ap  ”  ap-l  =  -  =  ak+l  =  0  (B-10) 

Hence  the  columns  of  [X^ ,  X2  ,  .  .  . ,  X^]  span  the  null  space 
of  N  . 

This  suggests  a  method  for  the  construction  of  the 
array  (B-5) .  Choose  a  matrix 

W1  =  [WX,W2, . . . ,Wr]  (B-ll) 

such  that  W1  constitutes  a  basis  for  the  null  space  of 

N.  it  is  clear  that  the  vectors  in  W-j^  are  also  in  the 

o 

null  space  of  N  .  Extend  these  vectors  to  form  a  basis 


■ 


2 

for  the  null  space  of  N  : 


[W 


•  •  •  / 


Ws]  =  P»  .W2] 


(B-12) 


Suppose  that  N(W2a)  =  0  for  some  nonzero  a.  This  is 

also  in  the  null  space  of  N  that  is, 


V^a  -  W13  =  0 


(B-13) 


Since  from  eqn.  (B-12)  and  W ^  are  linearly  independent, 
a  and  3  must  be  zero.  This  implies  that  the  columns 
NW2  are  in  the  null  space  of  N,  being  independent  of  W^. 
Proceeding  in  this  manner  we  can  construct  the  array 
(B-5) ,  which  can  be  rewritten  in  the  form  of  (B-l) . 

Thus  the  assumption  is  correct. 
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Figure  4 (a) :  Plant  State  Responses  of  the  Closed-Loop  System  for 
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Figure  4 (b) :  Plant  State  Responses  of  the  Closed-Loop  System  for 
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Figure  4(c):  Plant  State  Responses  of  the  Closed-Loop  System  for 
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Figure  4(d):  Plant  State  Responses  of  the  Closed-Loop  System  for 
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Figure  4(e):  Plant  State  Responses  of  the  Closed-Loop  System  for 


